A General Formulation for Least-Squares Problems
نویسندگان
چکیده
Abstract — We show in this paper that many different least-squares problems which have applications in signal processing may be seen as special cases of a more general vector space minimization problem called the Minimum Norm problem. We show that special cases of the Minimum Norm problem include: least squares fitting of a finite set of points to a linear equation and to a quadratic equation; the infinite length MMSE-optimum linear equalizer; the finite length MMSE-optimum linear equalizer; the steepest descent algorithm and the more practical LMS algorithm for iterative estimation of the finite-length MMSE-optimum linear equalizer for an unknown channel; and the finite-length least-squares-optimum linear equalizer with a forgetting factor. These examples are not exhaustive but are chosen to illustrate the scope of this framework.
منابع مشابه
Least squares weighted residual method for finding the elastic stress fields in rectangular plates under uniaxial parabolically distributed edge loads
In this work, the least squares weighted residual method is used to solve the two-dimensional (2D) elasticity problem of a rectangular plate of in-plane dimensions 2a 2b subjected to parabolic edge tensile loads applied at the two edges x = a. The problem is expressed using Beltrami–Michell stress formulation. Airy’s stress function method is applied to the stress compatibility equation, and th...
متن کاملSuperlinearly convergent exact penalty projected structured Hessian updating schemes for constrained nonlinear least squares: asymptotic analysis
We present a structured algorithm for solving constrained nonlinear least squares problems, and establish its local two-step Q-superlinear convergence. The approach is based on an adaptive structured scheme due to Mahdavi-Amiri and Bartels of the exact penalty method of Coleman and Conn for nonlinearly constrained optimization problems. The structured adaptation also makes use of the ideas of N...
متن کاملWavelet Least Square Methods for Boundary Value Problems
This paper is concerned with least squares methods for the numerical solution of operator equations. Our primary focus is the discussion of the following conceptual issues: the selection of appropriate least squares functionals, their numerical evaluation in the special light of recent developments of multiscale and wavelet methods and a natural way of preconditioning the resulting systems of l...
متن کاملTime integrations in solution of diffusion problems by local integral equations and moving least squares approximation
The paper deals with the numerical solution of initial-boundary value problems for diffusion equation with variable coefficients by using a local weak formulation and a meshless approximation of spatial variations of the field variable. The time variation is treated either by the Laplace transform technique or by the linear Lagrange interpolation in the time stepping approach. Advanced formulat...
متن کاملMLPG Formulation of the Multipoint Meshless FDM
Discussed is here the multipoint meshless finite difference method (MMFDM) following the original Collatz [2] multipoint concept, and the essential ideas of the meshless FDM [3]. The Collatz approach was based on interpolation, regular meshes and the local formulation of b.v. problems. On the other hand in the MFDM we deal with the moving weighted least squares (MWLS) approximation, arbitrarily...
متن کامل